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sable de disposer de registres des naissances et des 
traiter correctement les problemes administratifs et jurl- 
ammes sociaux et economiques, notamment 


ll est pratiquement indispen 
décés complets et exacts pour 
diques et pour assurer le rage pada bay 

domaines de la santé et de la medecine. . : 
gt ateggioa régions é€conomiquement moins développees ou le besoin de données 
exactes concernant les naissances et les décés est le plus vif, l'enregistrement des 
déclarations d'état civil est souvent inexistant, peu sir, ou fort incomplet. De nombreuses 
années sont nécessaires pour établir un registre complet. Dans 'intervalle, l'enregistre- 
ment dans des zones d’échantillonage spécialement choisies peut fournir des estima- 
tions sur les taux nationaux de naissances et de décés et constitue une experience 
pilote dans |’éstablissement d'un registre complet. Il est de la plus haute importance de 
connaitre le degré d’intégralité d'un enregistrement dans la zone d échantillonage. Il 
est proposé dans cet article que la portée des résultats soit vérifiee au moyen de la 
méthode bien connue du couplage individuel des événements enregistres avec un 
registre indépendant des mémes événements. Le registre indépendant des naissances 
et des décés serait confectionné a partir d’enquétes des ménages. Le recours au Coup- 
lage individuel permet d’évaluer l'intégralité tant du registre que des événements en- 
registrés lors de l’enquéte des ménages. 

La caractéristique d’évaluation qui ressort du systeme proposé pourrait contribuer a 
la mise au point d'un enregistrement et a la conduite d’enquétes plus efficaces. 


A complete and accurate register of births and deaths is virtually indispensable for 
the proper handling of administrative and legal problems, and for the success of social 
and economic programs, especially in health and medicine. 

In economically underdeveloped areas, where the need for accurate data regarding 
births and deaths is most acute, vital registration is frequently non-existent, unreliable, 
or far from complete. It takes many years to establish a complete register. Meanwhile, 
registration in specially chosen sample areas can provide estimates of national birth and 
death rates, and constitute pilot experience in the establishment of a complete register. 
It is of crucial importance that the degree of completeness of registration in the sample 
area be known. It is proposed here that coverage of the results be ascertained by the 
well-known technique of individual matching of registered events with an independent 
record of the same events. The independent record of births and deaths would be as- 
sembled through household interviews. The use of individual matching makes it possible 
to evaluate the completeness both of the register and of the events recorded in the 
household survey. 

This evaluation feature of the proposed scheme could help in the design of more 
effective registration and more effective surveys as well. 


Un registro de nacimientos y defunciones completo y exacto es virtualmente indis- 
a para el trato apropiado de problemas administrativos y juridicos, tanto como 
pms de programas sociales y econémicos, especialmente de la salud y 
he Se dohaee nee subdesarrolladas, donde existe una necesidad aguda de 
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La caracteristi id 
eestic eae ee de evaluacion del esquema presentado, podria ayudar a disefar un 
erectivo asi como encuestas mas efectivas. 


Seltzer Some Results From Asian Population Growth Studies 


et aux décés, dont la portée a été etablie en comparant les divers éléments d'une série 


estimation des taux non ajustés de l’'accroisement naturel; (3) on note, dans chaque 
type de systeme de collecte des données, une grande variabilité en ce qui concerne la 
portee des taux résultant des observations: (4) dans l'ensemble, il semble que les 


enquétes des ménages, lorsqu’elles ne sont pas répétées, donnet lieu a des comptes 
rendus incomplets. 


Coverage estimates of births and deaths derived from the matching experience of a 
relatively comprehensive group of studies conducted in Asia and employing dual col- 
lection systems are presented and analysed. Major conclusions based on these Asian 
Studies include: (1) coverage of live births has generally been more complete than that 
for deaths; (2) nevertheless, unadjusted rates of natural increase tend to be underesti- 
mates; (3) there is a great variability within each type of collection system in the cover- 


age rates observed; and (4) one-time household Surveys, aS a group, seem to be par- 


ticularly subject to underreporting of vital events. 


Se presentan y analizan las estimaciones sobre la cobertura de nacimientos y de- 
funciones derivadas de la experiencia de confrontar un grupo de estudios, relativamente 
comprehensivo, conducidos en Asia, los que han sido hechos empleando un sistema 
de recoleccién dual. Las conclusiones principales de estos estudios asiaticos son: 1) la 
cobertura de nacimientos vivos ha sido generalmente mas completa que la de las de- 
funciones; 2) no obstante, las tasas sin ajustar de crecimiento natural tienden a estar 
subestimadas; 3) hay una gran variabilidad en la cobertura de las tasas observadas 
dentro de cada tipo de sistema de recoleccion; y 4) encuestas de hogares de Unica-vez 
como grupo, parecen ser incompletas en cuanto a la informacion de hechos vitales. 


THE DESIGN OF AN EXPERIMENTAL PROCEDURE 
FOR OBTAINING ACCURATE VITAL STATISTICS 


Ansley J. Coale 

Probably a majority of the world's population lives in areas where the registration of births and 
deaths is either absent or so incomplete as to be an unreliable indicator of birth and death rates. In the 
long run there is no substitute for a complete register of vital events. The registration of individual 
births has proven an indispensable adjunct to resolving legal and administrative problems, and the registra- 
tion of deaths (including an accurate recording of the cause of death) is invaluable for the administration 


Of medical and health programs. 


It will be years, however, before many of the countries just embarking on a program of industrializa- 
tion and modernization will be able to attain complete or nearly complete registration of all births and 
deaths. In the meantime, accurate knowledge of current levels of fertility and mortality and of differen- 
tial rates according to various characteristics of the population are indispensable to an understanding of 
the population problems in each country, to the formulation of policies with respect to family limitation, 
and to the design and operation of an efficient public health program. In the interval, while a complete 
registration system is being developed, and, indeed, as an important aid in developing such a program, the 
recording of births and deaths for a representative sample of the national population would be of the high- 


est value. 


The following notes represent an attempt to outline in specific detail a proposal for obtaining ac- 
curate data on the number of births and deaths in a sample area. The author can make no claim of originality 
in setting forth this proposal. Use was made of individual matching of data from a register and from a sur- 
vey in the United States Censuses of 1940 and 1950, and the technique was refined and tested with data from 
the Singur Health Unit near Calcutta by Chandrasekar and Deming.* The only novelty in the scheme proposed 
here is the application to a sample area. The idea of sample registration areas (without the proposed system 


of verification) has been widely entertained. 


The underlying technique is to obtain data on individual events in the sample area by two independent 
means. The events recorded by each means of measurement must be identified accurately enough to establish a 
"match" of the two records of the same event. The two systems of measurement would be as complete a regis- 
ter as possible of births and deaths in the sample area, and some form of periodic household survey--probably 


every year--that asks for births and deaths during the interval since the preceding survey. 


*Chandrasekar, C. and Deming, W. Edwards, "On a method for estimating birth and death rates and the extent 
of registration," Journal of the American Statistical Association, Vol. 44 (1949), pp. 101-115. [Reprinted 


as No. 1 in the Reprint Series of the Laboratories for Population Statistics (May 1971)] 


Reprinted from /nternational Population Conference, New York, 1961, Vol. 2, London, International Union for the Scien- 
tific Study of Population, pp. 372-376 with permission of the publisher. 5 


The simplest form of experiment would require the selection of a scientific sample of villages in the 


region where the experiment is to be conducted, and the initiation of the two systems of data collection in 


all these villages. The registration might be either some experimental form of improvement of an existing 
registration system, or alternatively a wholly new registration scheme, employing, for example, health work- 
ers or school teachers. A possible form of improvement of existing machinery might be renumeration of the 
local registrar on a piece-rate basis, with some offsetting penalty for false registration. The household 
survey could experiment with various probing devices, such as asking for pregnancies and subsequently in- 


quiring how each pregnancy has terminated (and similarly with illnesses); asking for children born who are 


still alive and then about children who have died, etc. 


The most difficult feature of an experiment of this sort will be to establish the match between events 
recorded in the periodic household survey, while at the same time maintaining the independence of the two 
sources of information. Experience with matching shows surprisingly frequent instances of uncertainty as to 
whether the two events are in fact different or the same. The address reported for a birth in the register 
and a birth in the household survey may be the same, but the name or perhaps the sex recorded for the child 
may be different. The problem is complicated by the fact that it is not only necessary to establish identity 
or lack of identity, but to find out whether an event reported by one system and not the other should indeed 
be included in the universe of properly recorded vital events. For example, if a birth is reported ina 
household survey and not in the register there is always the possibility that the birth may have occurred in 
the preceding year on the one hand, or in another village on the other. In either case it would be inappro- 
priate to count this as an omission from the register. In practice it may be necessary to effect a reconcil- 
jation in each instance where one system records an event not recorded by the other system. The problem of 
independence will doubtless become increasingly acute as an attempt is made to continue the two systems side 
by side in the same village. It will be very difficult to convey the nature of the scientific problem in- 
volved to the local registrar and to the surveyors who conduct the household interview. They will doubtless 
learn, because of the reconciliation procedures, that the results of each person's work are being used to 
check the other's. There will be a strong tendency for the two lists to approach identity through collab- 
Oration rather than completeness. It will take good administrative machinery and very close supervision to 


see that such collaboration does not occur. 


In spite of the major difficulties just described there seems little doubt that an event-by-event 
matching of two independent systems represents the most promising technique for assessing the accuracy of 


any system of recording. A comparison without individual matching between two systems serves only to compare 


their relative completeness. A register and a survey might, for example, both indicate a birth rate of 38 
and a death rate of 18 for some Indian state, when the true figures were 45 and 25 respectively. Agreement 
with regard to number of events between register and survey, however, would indicate no more than that they 


both achieve about the same degree of completeness. In contrast, the individual matching of records makes 


it possible to estimate the completeness of both systems. In fact, the only major deficiency of the match- 
ing procedure (assuming that the problem of matching itself can be adequately solved) is the existence of a 
correlation between the probability of omission from each of the two systems. The existence of correlation 
makes it difficult to estimate the number of instances of events undetected by both systems. However, 


Chandrasekar and Deming* have developed a procedure for estimation even in the presence of correlation. 


This procedure is the division of events into Sub-classes, each characterized by its own rate of 
omission. It can be shown that such a division leads to a more adequate estimate of the total number of 
events omitted from both register and survey. It is important to divide events into Classes by a criterion 
that distinguishes frequent from infrequent.omission. A promising and easily applied criterion for deaths is 
age at death; a useful two-way division is deaths under one year and ald other deaths. Births may be separa- 
ted into those of children recorded as dying before the first birthday, and all other. The basis for these 
suggested divisions is that infant deaths are usually reported in an especially incomplete manner, and births 


of non-surviving children are especially subject to omission. 


Various elaborations of this basic experimental design can be imagined and might be profitable. Among 
the possibilities are the following: 

1. Simultaneous experimentation with one or more techniques of registering and one or more household 
Survey methods. If we designate the registration schemes as A and B and the enumeration schemes as 1 and 2, 
it would be possible to utilize interpenetrating subsamples using combinations A-1, A-2, B-1 and B-2. The 
result would be not only an estimate of birth and death rates in the area and of the completeness of the reg- 
istration system being used in the non-sampled villages, but also an appraisal of the relative effectiveness 


of the alternative registry and survey schemes. 


2. Additional sample villages could be added in which the Survey system only and the registry system 
only were used in order to obtain an estimate of the effect on the completeness of the measurement of having 
a continuous check. The point is that the existence of matching will no doubt effect the performance of the 


registrar, of the enumerators, and possibly of the households themselves. 


The advantages of this experiment, if it is at all successful, would be many. First, the result would 
be a reliable (and verified) estimate of vital rates. Second, the experiment would cumulate experience in 
the successful operation of a system of registration, which would make it possible to plan the gradual 
achievement of a state-wide or nation-wide registration of vital events. Third, the experiment would yield 


valuable data on the quality of survey information, and on the nature of recall lapse, and other systematic 


defects. 


“Op. Cit. 
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SOME RESULTS FROM ASIAN POPULATION STUDIES 
William Seltzer 


INTRODUCTION 

The purpose of this paper is to bring together some results from a number of population growth 
estimation studies conducted in Asia since 1945 and to indicate a few generalizations suggested 
by these results. This review is limited to studies in which two collection systems are used 
simultaneously to gather basic data on vital events from the same population. Such a dual system 
provides a direct means by which the coverage of each source can be evaluated. Excluded are 
estimates based on a single, unevaluated census, household Survey, Or Civil registration system, as 
well as estimates based on demographic analysis of census or survey data. 

The studies considered are drawn from five countries ranging from Turkey in the West to 
Korea in the East and include data collected in normal civil registration systems, various special 
registration systems, and one-time and multiple-visit household surveys. Background data on the 
studies covered are summarized in Table 1.! This table provides information about the place 
where each study was conducted, the name of any larger study of which the listed study was a 
part, the coverage period (in terms of the date of occurrence of in-scope events), a brief description 
of each of the two collection systems used, and the approximate population covered. Unless other- 
wise mentioned in the description of the system, the recall period for multiple-visit household 
surveys extends to the date of the previous visit. In the case of sample studies the approximate 
population covered refers to the population in the sample. 

Whenever possible, annual results of studies which used substantially the same methodology 
for a number of years have been combined into one set of coverage estimates for the full period 
for which data are available. This type of pooled experience is listed as a single study in Table 1. 
On the other hand, national sample studies for which coverage estimates can be derived for different 
geographical regions are listed separately in Table 1 for each such area. Basically, then, the 19 
listings in Table 1 refer to a series of populations, in each of which reports of vital events occurring 

1 Omitted from Table 1 and this review are two studies in which the matching was done only ‘one-way’, i.e. the 
number of unmatched reports of only one of the two systems could be identified. For details, see Department of 
Census and Statistics, Post Enumeration Survey 1953, Monograph No. 1 (Ceylon Government Press, 1953), and 
Central Bureau of Statistics, Government of Indonesia, ‘A Study of the Completeness of Birth and Death Statistics 
in Indonesia’, Paper prepared for the ECAFE Seminar on Civil Registration and Vital Statistics, Copenhagen, 
July-August 1968. In addition, no comparable coverage estimates could be prepared on the basis of results currently 
available for the 1967 Ceylonese registration check, for a number of states participating in the Indian Sample 
Registration Scheme, and for the continuing study in the Lulliani area of West Pakistan conducted by the West 
Pakistan Research and Evaluation Centre, Lahore. Preliminary information available from the Sample Registration 
Scheme for states that are not covered in this review and from the Lulliani Project appear to be consistent with the 


general findings presented here. Undoubtedly other relevant studies have been omitted. However, their exclusion 
was inadvertent and the author would welcome assistance in locating them. 


Reprinted from Population Studies, Vol. 23, No. 3, pp. 395-406 with permission of the publisher. 
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in a specified time period were collected by means of two relatively unvarying systems. Each of 
these 19 listings is treated as an independent and distinct study in this review, whether or not it is 


part of a larger study. 


DERIVATION AND LIMITATIONS OF COVERAGE ESTIMATES 
In each of the studies listed in Table 1, data on live births and deaths were obtained by two methods 
and the reports on births and deaths collected in each system were matched with those collected by 
means of the other system in order to determine which were reported by both and which by either 
system alone. With this information one can, subject to certain limitations, estimate the completeness 
of coverage of each system and the proportion of events missed by both systems.? 

Specifically, the proportions of births or deaths reported by the first system that are also 
reported by the second system are used to estimate the coverage of the second system.? Stated more 
simply, the match rate of the first system is the coverage estimate of the second system and the 
match rate of the second system is the coverage estimate of the first system. In algebraic terms 

=-3 (1) 


where 
C =events (births or deaths) common to S,; and S, determined by matching; 


S, =the number of events (births or deaths) reported by one system; 
S, =the number of events (births or deaths) reported by the other system; and 
N =total number of births or deaths. 
Transposing expression (1), we have a method of estimating the total number of events adjusted for 


both underregistration and underenumeration: 

ve a ; (2) 
In fact, this estimate, which was used for many years by the U.S. National Office of Vital Statistics 
to adjust United States birth registration data for underegistration,* is identical to the 
Chandrasekaran-Deming estimate.® It is therefore possible to derive Chandrasekaran—Deming 
estimates from any study for which the total number of reports (or the number of unmatched 
reports) of both systems and the match rate of either system (or the number of reports common 
to both systems) are available, whether or not such estimates were explicitly made in the original 
study. 


? C. Chandrasekaran and W. Edwards Deming, ‘On a method of estimating birth and death rates and the extent of 
registration’, Journal of American Statistical Association, 44, 245 (1949), pp. IOI-II5. 

*S. Shapiro, ‘Development of birth registration and birth statistics in the United States’, Population Studies, 
4, I (June 1950), p. 98. 

* See, for example, Robert D. Grove, Studies in the Completeness of Birth Registration: Part I. Completeness of Birth 
Registration in the United States, December 1, 1939 to March 31, 1940, U.S. Bureau of the Census, Vital Statistics — 
Special Reports, Vol. XVII, No. 18, 1943; and Sam Shapiro and Joseph Schachter, Birth Registration Completeness 
in the United States and Geographic Areas, Part I: Data for Each State, National Office of Vital Statistics, Vital 
Statistics - Special Reports, Vol. 39, No. 2, 1954. 

* This can be seen by substituting C+ N, for S , and C+N, for S, in expression (2) and expanding. The result 
can be recombined into the usual Chandrasekaran—Deming formula, i.e. C+ N,+N,+(N,N,/C). 


In order that coverage estimates based on matching studies should be unbiased, the two systems 
employed in each study must be statistically independent, the net matching error should be zero 
(i.e. the number of false matches equal to the number of false non-matches) and all spurious (out-of- 
scope) reports must be eliminated from each system. In the present context, statistical independence 
means that the probability of one system catching an event is not related to the probability of the 
other system including it. As Chandrasekaran and Deming pointed out,® lack of independence can 
be largely offset by preparing separate estimates for groups of events which have relatively similar 
coverage rates and summing the individual estimates. In the few instances where this approach was 
attempted only minor gains were obtained,’ indicating that either independence was not a problem 
or the groups used were not actually homogeneous with respect to coverage. With regard to spurious 
reports, most of the studies listed in Table 1 re-investigated the non-matched reports in the field in 
order to detect and eliminate those which did not refer to in-scope events. While the effects of 
matching errors and the lack of independence often, at least partially, cancel out,* the existence of 
these biases must be kept in mind when interpreting coverage estimates. 


COVERAGE ESTIMATES FOR BIRTHS AND DEATHS 
Estimates of completeness of coverage by collection system for each study are shown in Table 2 
for births and for deaths. The coverage estimates are calculated from the data shown in the sources 
listed beneath Table 1. In a few instances, the estimates of coverage in Table 2 differ from the 
coverage estimates provided in the sources themselves. This situation arose either when the 
original study did not make use of expression (1), or its equivalent, in preparing coverage estimates 
or when the coverage estimate of the original study was prepared on the basis of separate estimates 
for population sub-groups assumed to have similar coverage rates. The variations in the coverage 
estimates shown in Table 2 reflect true differences in coverage as well as the sources of bias mentioned 
earlier. In most cases lack of independence can be expected to overestimate coverage, matching 
errors either to over or to underestimate coverage and spurious reports to underestimate coverage. 
Among these 19 studies, Table 2 provides 38 coverage estimates for births — two per study — which 
range from 28 to 96%. The median proportion covered for births among these 38 collection systems 
was 77°%. For deaths, the coverage estimates range from 23 to 91 °/ with a median of 69%. 

It is clear from these data that the estimated coverage of live births is typically higher than 
that for deaths in Asian PGE studies. Based on the 38 collection systems taken together, the 
median coverage rate for births is about 11°% higher than that for deaths. Similarly, the estimated 
coverage of births is higher than that for deaths in all but four of the 38 systems. 

6 Chandrasekaran and Deming, loc. cit., pp. 106-107. 

7 Estimates based on the summation of sub-group estimates were prepared in Thailand’s Survey of Population 
Change, Pakistan’s Population Growth Estimation Experiment, and India’s Singur Health Centre Study. Only in the 
last-named study was any meaningful difference observed between the results of the disaggregated and the global 
methods of estimation. Even in this case the difference was evident for only one of the variables tried. See 
Chandrasekaran and Deming, loc. cit., pp. IIO-III. ; 

§ William Seltzer and Arjun Adlakha, ‘On the Effect of Errors in the Application of the Chandrasekaran—Deming 


Technique’, Paper prepared for the Population Council Seminar on the Chandrasekaran—Deming Technique: 
Theory and Application, New York, 23rd January, 1969. 
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The ratios of the omission rate for births (i.e. one minus the coverage rate) to the omission 
rate for deaths vary considerably among the individual collection systems — but for only oné out of 
the 38 systems is the estimated omission rate for deaths more than 2°4 times the rate for births. 
(The median ratio of the omission rates is about 1:3.) Despite the higher omission rates for esain 
compared to those for births, the resulting estimates of natural increase tend to be too low. This 
will be the case as long as the ratio of births to deaths (or of the birth rate to the death rate) in the 


TABLE 2. Estimated coverage of births and deaths for each collection system in selected Astan PGE studies 


(Coverage of each system expressed as a percentage of the estimated total for each study) 


System I System 2 
Study j 
number Estimated coverage Estimated coverage 
Type of system Type of system 
Births Deaths Births Deaths 
I Civil registration §2 48 One-time survey 53 32 
2 Civil registration 60 5I One-time survey 67 51 
3 Civil registration 43 44 One-time survey 93 90 
4 One-time survey 96 88 One-time survey 92 88 
5 Special registration 92 QI Multiple-visit survey 89 89 
6 Civil registration 86 82 One-time survey 65 51 
2 Special registration 89 74 Multiple-visit survey gI 81 
8 Special registration 83 85 Multiple-visit survey 92 89 
9 Civil registration 43 33 One-time survey 28 a3 
Ce) Special registration 83 84 Multiple-visit survey 75 61 
II Special registration 76 77 Multiple-visit survey 71 56 
12 Civil registration 84 63 Multiple-visit survey 87 80 
13 Special registration 67 61 Multiple-visit survey 86 82 
14 Special registration 67 61 Multiple-visit survey 82 70 
15 Special registration 70 62 Multiple-visit survey 83 75 
16 Special registration 67 64 Multiple-visit survey 82 72 
17 Special registration 62 50 Multiple-visit survey 66 50 
18 Special registration 67 68 Multiple-visit survey 77 70 
19 Special registration 66 58 Multiple-visit survey 86 a2 


NOTE: For sources and limitations of data, see Table 1 and text. 


population under study is greater than the ratio of omission rate for deaths to the comparable 
omission rate for births.® Since the ratio of births to deaths among the countries of Asia averages 
about 2-6,’ rates of natural increase will be underestimated whenever the omission rates for deaths 
are not greater than about 2-6 times those for births. The available evidence thus suggests that 
unadjusted registration, survey or census results in many Asian countries tend to underestimate the 
rate of population growth. 


* Ibid. See also, United Nations, Methods of Estimating Total Population for Current Dates, Population Studies 
No. 10 (New York, 1952), p. 38, footnote 1. 


1° The ratio quoted was calculated from estimates presented in United Nations, Population and Vital Statistics 
Report: Data Available as of 1 October 1968, Statistical Papers Series A, Vol. XX, No. 4, for the sovereign countries of 
Asia, 


COVERAGE ESTIMATES BY TYPE OF COLLECTION SYSTEM 

Each of the 38 collection systems can be classified into one of four broad types: civil registration, 
special registration, one-time household surveys or multiple-visit household surveys. The median 
and range of coverage estimates by type of system are shown in Table 3. In addition to the general 
limitations of the method of analysis used in this review, the comparative data shown in Table 3 are 
subject to additional limitations due to the small number of examples available for each type of 
system. Nevertheless, the marked differences in median estimated coverage are suggestive. For 
both births and deaths the civil registration systems have the lowest median, then come, in the order 
of increasing median coverage, one-time household surveys, special registration systems, and 
multiple-visit household surveys. Median estimated coverage among the multiple-visit household 
surveys is about 45% higher than that for the civil registration systems for both births and deaths. 


TABLE 3. Median and range of estimated coverage of births and deaths by type of collection system, 
selected Asian PGE studies 


(Coverage of each system expressed as a percentage of the estimated total for each study) 


ne ee mannan mnaeneneneniatidns ani man aa 


Number | Estimated proportion | Estimated proportion 
Type of system of of births covered of deaths covered 
systems 


Median Range Median Range 


eecessrnceesacnnapanennstiessnactiagasnesans sitesi assis AiAAN TEOTETEELL  S OLA ESe 


All types 38 77 28-96 69 23-91 
Civil registration 6 56 43-86 49°5 33-82 
Special registration 12 473 62-92 66 50-91 
One-time household survey q 67 28-96 51 23-90 
Multiple-visit household survey 13 83 66—92 72 50-89 


ee eS en eee EEEEEEMEEes ents Aa 


NOTE: For sources and limitations of data, see Table 1 and text. 


Except for the one-time household surveys, median coverage rates for births are between I0 
and 15% higher than those for deaths, regardless of the type of system. However, among the 
single-visit household surveys median coverage for births is 31° above that for deaths. In low- 
mortality countries it has been found that single-visit retrospective household inquiries are 
particularly unsuitable for obtaining a full count of deaths in a population." These data suggest that 
the same may be the case in Asia. 

Shifting from the medians to the ranges presented in Table 3, it is clear that coverage both for 
births and for deaths varies very widely within each of the four type of systems. Thus it would 
appear that the application of any particular system is at least as important as the choice of the 
system itself. This variability also argues against relying on predetermined factors inferred from 
experience in other countries, or even from other studies in the same country, to adjust any particular 


set of data for underregistration or underenumeration of vital events. 


1! U.S. National Health Survey, Hospital Utilization in the Last Year of Life, Health Statistics, Series D, No. 
3, U.S. Department of Health, Education and Welfare, Washington, D.C., 1961. 
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Another way of looking at coverage is to examine the proportoin of the estimated total number 
of events that are covered by both systems, covered by the first system only, covered by the second 
system only, and missed by both systems, i.e. to distribute the estimated total into the four 
Chandrasekaran—Deming categories: C, N,, N. and X.! This breakdown is presented in Table 4 
for births and Table 5 for deaths for the 19 studies listed in Table 1. For these studies the proportion 
estimated as missed by both systems is relatively small — the median being 5% of the estimated 
total for births and 9° for deaths. The median proportion covered by both systems is 56% for 
births and 44° for deaths. The remaining events were caught by only one of the two systems used. 


TABLE 4. Percentage distribution of estimated total births, by coverage category, for selected Asian 


PGE studies 
Estimated Percentage distribution 
Study total serine ieee RRR na = on peeing RRR aie 
number births Estimated | Caught by System 1 | System 2 Missed by 
total both systems only only both systems 
I 2,908 100 27 24 25 24 
2 3,744 100 40 20 27 13 
3 746 100 40 3 53 4 
4 412 100 88 8 3 I 
5 1,591 100 82 10 4 I 
6 806 100 56 30 9 5 
7 874 100 81 8 10 I 
8 18,964 100 76 * 16 I 
9 13,268 100 12 31 16 4I 
10 8,719 100 63 21 oe 4 
II 9,138 100 54 22 17 7 
I2 75305 100 73 II 14 2 
13 1,234 100 a7 2] 29 > 
14 2,041 100 54 12 27 6 
I5 904 100 58 12 25 5 
16 1,664 100 55 12 27 6 
17 914 100 4I 21 25 13 
18 439 100 59 17 19 5 
19 331 100 56 9 30 5 


I a eee | eee 


NOTE: For sources of data and their limitations, see Table 1 and text. 


There are considerable variations in these proportions among the various studies. In point of 
fact, these relative distributions are directly related to the estimated coverage rates shown in Table 2. 
Recalling from expression (1) that, assuming statistical independence, 
Cs 
Sok 
it follows that the proportion of the estimated total caught by both systems is equal to: 


me. C Same 
llc “es (3) 


* Chandrasekaran and Deming, loc, cit. 3 Pp. 102. 


Similarly, the proportion of the estimated total missed by both systems, i.e. Chandrasekaran and 
Deming’s ‘fourth category’, is equal to: 


=-S)(-9-(-M-9) : 


It follows from this that the proportion of the estimated total caught by both systems must always 
be smaller than the smaller match (or coverage) rate, while the relative contribution of the fourth 
category is always less than the smaller non-match (or omission) rate. 


TABLE 5. Percentage distribution of estimated total deaths, by coverage category, for selected Asian 


PGE studies 
Estimated Percentage distribution 
Study total erm: 
number deaths Estimated Caught by System I | System 2 Missed by 
total both systems only only both systems 
I 2,234 100 16 33 17 35 
2 1,696 100 26 25 25 24 
3 328 100 40 5 50 6 
4 56 100 77 II II I 
5 618 100 81 IO 8 I 
6 359 i Cole) 42 40 9 9 
7 310 100 60 14 21 5 
8 5,302 100 76 9 14 2 
9 23,553 100 8 26 15 52 
+e) 3,152 100 52 32 fe) 6 
II 3,088 100 44 34 13 10 
I2 1,867 100 50 I2 30 7 
13 417 100 50 II 32 7 
14 782 100 42 19 27 I2 
15 284 100 46 16 28 se) 
16 552 100 46 18 26 se) 
17 262 100 25 25 25 25 
18 164 100 48 20 23 se) 
19 130 100 42 16 30 es 


NOTE: For sources of data and their limitations, see Table 1 and text. 


DISCUSSION 


Because the present review attempted to be as inclusive as possible, there is considerable variation 
in the quality of the studies used in the analysis. ‘This variation has two main components: 
(1) variations in the type, quality and independence of the collection systems, and (2) variations in 
the matching and verification procedures. A more comprehensive analysis would attempt to control 
for variations in either or both of these components. At a minimum, it would be desirable to examine 
the extent to which coverage estimates for a particular type of system are merely an artifact of the 
type of system with which it was most frequently paired. Unfortunately, such an analysis will have 


to be deferred until results from a larger number of matching studies are available. 
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Another question of some importance is whether or not the multiple use of data wines the ae 
larger study (e.g., the Turkish Demographic Survey is represented seven times in this analysis, 
Pakistan’s PGE Experiment twice) gives undue weight to the experience of a particular set of 
procedures. It is apparent from variations in coverage rates by area that some real differences exist 
within the large national studies in either the application or the effectiveness of the procedures used. 
However, additional independent studies are needed in order to eliminate this source of uncertainty 
definitively. 

The estimates of completeness of coverage that serve as the statistical basis of the present 
review are derived solely from the results of matching the individual reports of two simultaneous 
collection systems. The approach used completely disregards any other evidence about coverage or 
quality, whether based on a simple judgment of the ‘reasonableness’ of the estimates of the vital 
rates or on the use of techniques of demographic analysis.!* For example, two quite inadequate 
household surveys matched with each other would yield erroneously high estimates of coverage if 
both systems were missing the same kinds of events. The fact that the estimated coverage rates were 
too high could be established by determining from external evidence whether or not the estimates 
of vital rates were too low. However, a decision about the ‘reasonableness’ of birth and death rate 
estimates is to a large extent a function of the training and experience of the demographer making 
the determination. To a lesser extent the accuracy of the various analytical techniques is also depen- 
dent on the skill of the demographer using them."4 

Since the present review includes studies from five countries and a larger number of areas, the 
time and specialized knowledge needed to make such independent assessments of each estimate 
would have been considerable. Moreover, in a number of Asian countries there is so much 
uncertainty about current levels of fertility and mortality and the supporting demographic data are 
subject to such large errors, that a number of demographers would question the correctness of any 

judgment made. Nevertheless, the overall coverage patterns indicated by the present limited analysis 
tend to support the findings of others!5 who did make use of various kinds of external data to assess 
quality. 

While the limited, non-judgmental analysis used may be justifiable in this review, it is certainly 
not appropriate when evaluating the quality of the estimates produced by a particular PGE study or 
for a particular country. In that situation one would want to make use of as many different sources of 
data and as many techniques of estimation as resources permit, since no one approach is free from 
error. Viewed in this light, estimates based on matching studies and those based on methods such as 
the Brass technique are complementary rather than competitive. It would appear that, unless only 
very rough approximations of current fertility and mortality are required, designs for new population 
growth estimation studies should provide both for a full matching operation and for the collection 
and tabulation of information needed to make use of analytical techniques. 

. Ansley J. Coale and Paul Demeny, Methods of Estimating Basic Demographic Measures from Incomplete Data, 
Sg sea gee of Economic and Social Affairs, Population Studies No. 42 (New York, 1967). 

*'W. Parker Mauldin, ‘Estimating rates of population growth’, in Family Planning and Population Programs, 
edited by Berelson et al., (Chicago, 1966), pp. 635-653; and Sultan S. Hashmi, ‘Use of household surveys for 


measuring population changes in developing countries with special reference to Pakistan’, Proceedings of the CENTO 
Symposium on Household Surveys, Dacca, 1966 (Ankara, 1967), pp. 165-182. 
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